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(54) Method of performing geometric measurements on digital radiological images using 
graphical templates 



(57) Method of performing geometric measure- 
ments on digital radiological images, using graphical 
templates. 

A digital image representation of a radiological im- 
age is acquired and displayed on a display device. A 



measurement template, comprising the set of measure- 
ment points or areas to be measured, is retrieved and 
displayed adjacent to the digital image. The measure- 
ment points or objects are mapped on to the displayed 
image and the resultant measurements stored. 
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Description 

FIELD OF THE INVENTION 

5 [0001] The present invention relates to computer-assisted radiological measurements on radiographic images. 
BACKGROUND OF THE INVENTION 

[0002] In musculoskeletal radiology, it is current practice to use a wide range of imaging modalities to determine 
10 skeletal disorders and abnormalities. 

[0003] In this discipline diagnosis is often based on quantified radiological findings of geometrical quantities. 

At least 50% of all radiological examinations today are conventional exposures of thorax and the skeleton. 80% of 

skeletal exposures leads to the correct diagnosis based on the radiographs. 

A plurality of textbooks in the X-ray diagnostics from world-renowned radiological and orthopaedic experts make a 
15 contribution in this area. 

[0004] However, to refine the diagnosis, to conduct better differential diagnosis, to assess severity of change, to plan 

and control therapy, to conduct treatment follow-up, to establish physical ability in sports medicine, labour medicine 

and military medicine, verbal descriptions based on skeletal radiographs are insufficient in many respects. 

Better diagnosis can be achieved by quantifying radiological findings. 
20 [0005] Geometrical quantities measured on radiological images must be checked against normal values. These 

normal values have been collected from measurements of a representative sample of the normal healthy population 

and are tabulated in the above-mentioned text books. 

[0006] Geometrical measurements in digital images comprise linear and angular measurements. Linear measure- 
ments in 2 dimensions and 3 dimensions may be supplemented with distance along a curvilinear path. Angular meas- 
es urements are considered in the plane of the image, in a world plane or in 3D space. Geometrical areas are considered 
in the image plane, or more generally of surface patches in 3D images. Volumes are computed in 3D images but may 
be based on planar measurements. Geometrical indices are clinical quantities based on image measurements. In any 
of these categories, the measurand is defined as the physical parameter being quantified by measurement. 
[0007] Today, radiological measurements on X-ray images are either made on film using conventional measuring 
30 devices (such as a ruler, a caliper or a rubber band to measure lengths, and a square or goniometer to measure angles) 
or in a digital image displayed on screen using cursor controlled points (such as a pair of points to measure Euclidean 
distance between). 

[0008] The current measurement procedure thus involves 4 distinct media: 

35 1 . An X-ray film comprising the anatomical sites to be measured, displayed on a light box. With the emergence of 

digital radiography modalities (film digitisation, computed radiography, digital radiography sensors), the digital im- 
age may be displayed on a computer display. However, such electronic medium still is physically different from 
the other components described hereafter. 

2. A measurement atlas comprising the measurement scheme: imaging technique, graphical template and de- 
40 scription of the measurements covered by the scheme (nomenclature, clinical significance, and normative tables, 

sometimes interchangeably represented by curves) 

3. An analogue measurement device (ruler, square...) to perform geometrical measurements, 

4. Pencil/Paper to note the measurement quantity according to the appropriate medical nomenclature and the 
measurement value. 

45 

[0009] A calculator device may be needed to compute indices from a collection of measurements, or to convert 
measured values to true quantities using calibration measures. Alternatively, electronic spreadsheets may be used in 
conjunction with a database to store the measurements and indices. 

[001 0] The use of different media asks for repeated focusing of attention between the atlas and the radiological image. 
50 Moreover, in the absence of an atlas scheme the position of the measurement objects is not defined and hence different 
users may locate a given anatomical landmark differently. 

[0011] Because there is no link between the measurement template in the atlas and its associated measurement 
entities, there is no systematically imposed consistency of the naming of measured quantities, and therefore exchange 
or collection of measurement values of different clinicians (e.g. for the purpose of cross-refereeing) is fundamentally 
55 hampered. 

[0012] Another major drawback of the prior art method to perform geometrical measurements is increased meas- 
urement error or measurement uncertainty. 

The error of measurement is the result of a measurement value minus the (true) value of the measurand. Measurement 
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error is due to different sources, basically falling into one of two classes: systematic and random errors. 
[0013] Systematic or bias errors arise from consistent and repeatable sources of error (like an offset in calibration). 
Systematic errors can be studied through inter-comparisons, calibrations, and error propagation from estimated sys- 
tematic uncertainties in the sensors used. Systematic error is defined as the mean that would result from an infinite 
5 number of measurements of the same measurand carried out under repeatability conditions minus the (true) value of 
the measurand. This source of error can be reduced by better equipment and by calibration. 

[0014] Random errors also referred to as statistical errors, arise from random fluctuations in the measurements. In 
particular, digitisation noise (e.g. geometric digitisation: finite pixel size; intensity digitisation: quantisation of grey levels) 
and the errors introduced by counting finite number of events (e.g. X-ray photon count) are examples of random errors 

10 in the context of digital X-ray images. Random error is defined as the result of a measurement minus the measurement 
that would result from an infinite number of measurements of the same measurand carried out under repeatability 
conditions. Particularly this source of error is prevailing in the prior art of performing measurements on X-ray images. 
Inter-observer and intra-observer variance on measurement values contribute to this source of error, and has its origin 
in several forms of ambiguity in defining the measurand. 

15 Lack of unambiguous definition of the measurand with respect to the imaged patient anatomy and lack of knowledge 
of the geometrical pose of the patient with respect to source and detector are the main source of random error. 
[0015] Repeatability and reproducibility of a measurement require that the random errors involved in the measure- 
ment procedure are low. Although random errors are reduced when a measurement is repeated many times and the 
results averaged together, this can rarely be achieved in clinical practice. 

20 [0016] It is an object of the present invention to provide a user-friendly radiological measurement method that over- 
comes the drawbacks of the prior art. 

SUMMARY OF THE INVENTION 

25 [0017] The above-mentioned objects are achieved by a method as set out in claim 1 . 

[0018] The method of the present invention is described with regard to geometrical measurements performed on 
radiological images of humans. It will be clear that the invention is not limited to human beings and can also be applied 
in other fields, for example in veterinary applications. 

[0019] In the context of the present application the term 'activation' refers to loading a measurement scheme from 

30 memory and measurements to be performed according to the loaded scheme. 

[0020] A measurement scheme or measurement template is a pattern of measurements to be performed. The meas- 
urements to be performed are grouped in the form of a measurement procedure wherein the sequence, the inter- 
dependence and method of measurements are defined. Such a measurement scheme can be noted and stored in a 
computer in standard notation XML (Extensible Mark-up Language). 

35 [0021] In general the measurement scheme comprises a graphical part (also called graphical model) and an internal 
part (also called internal model). 

[0022] The graphical part represents the geometric relation between measurement entities (objects and operators) 

and the anatomy in the type of image on which the measurements are to be performed. Measurement objects are e. 

g. points, lines, circles etc. The measurement objects are defined relative to the anatomy. The intended position with 
40 respect to the anatomy is thereby unambiguously denoted. 

The measurement objects can be labelled e.g. with the appropriate medical nomenclature. Other kinds of naming are 

possible, e. g. for naming intermediate objects needed in the course of the measurement procedure. 

Measurement entities also comprise distances, angles which are the result of the measurement procedure and which 

are preferably also named according to medical convention. 
45 [0023] The graphical part may also comprise measurement mark up such as a graphical indication of distance or 

angle. 

It may also comprise textual annotations of the names of objects and entities. 

[0024] In the graphical part, a region of interest box around a set of measurement points may be superimposed, to 
indicate the area to which geometric operators (such as zooming) or intensity operators (such as enhancement or 

50 landmark extraction operators) can be applied. 

To ensure correct match with the image, e.g. with the imaged patient body part, the correct exposure parameters can 
be specified in the template, quantifying the imaging geometry. Angle of incidence and source-patient-detector dis- 
tances are the most important geometric parameters, which much be observed at exposure time for a specific template 
to be applicable. Specific data structures and methods of each measurement entity and object class are devoted to 

55 control their graphical content and behaviour. 

[0025] The measurement scheme may also comprise normative values associated with the measurement entities. 
These normative values are e.g. organised as a normative value table and are used for comparison with measured 
entities. Abnormal values may be signalled. 
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[0026] The internal part represents the functional dependencies between measurement entities. Functional depend- 
encies comprise type of measurements, measurement methods, location of a measurement entity in a measurement 
dependency graph, order in which measurements are to be performed etc. 

[0027] The internal model can be implemented as an object-oriented model of a coherent set of measurements to 
5 be performed on a digital (medical) image. 

It can for example be represented by a measurement dependency graph. The internal model decomposes each meas- 
urement of a physical quantity into its constituent measurement objects. It further specifies methods to map the objects 
geometrically onto the medical image. 

In informatics terms, the model is composed of objects belonging to an associated class, consisting of a collection of 
10 data structures and methods, said methods operating on the corresponding data structures. 

The flow of execution of the measurements of the measurement scheme is imposed by a measurement dependency 
graph, in which the nodes correspond to measurement of geometric objects, and directed arcs define the relationship 
between the nodes. 

[0028] As will be explained further on, the internal part may activate the nodes in several ways: 

15 

• sequential point-only operation will first address all measurement points priorto evaluating the measurement object 
and operator nodes; 

• the sequential measurement object operation will let fire each node immediately when the results of all children 
are available, representing the pure data-flow case; 

20 • a node representing a set of points linked to an active contour model will invoke an automatic segmentation com- 
putation in order to compute the location of the image mapped points prior to firing the nodes representing geo- 
metrical objects based on said mapped points. 

[0029] The graphical part and the internal part of the measurement scheme are bi-directionally linked such that the 
25 master-slave relation between the two parts is defined. The bi-directional link provides that measurements can be 
activated starting from the graphical part as well as starting from the internal part. 
[0030] This means that 

• either internal methods of the graphical objects may be invoked by addressing the graphical content of the meas- 
30 urement scheme. After pointing to a geometric entity in the stencil, a method, appropriate for the type and location 

of the geometric entity, is invoked to map the entity in the image. For example, clicking on a line may invoke the 
user interface method to position two pairs of juxtaposed points, each point pair yielding a midpoint coincident on 
the requested line. In contrast to a passive bitmap display of the measurement objects, which would require a 
knowledgeable user to map them graphically, the measurement scheme supplies the appropriate method. Anal- 

35 ogously, a complete sub-graph corresponding to a measurement operator in the measurement dependency graph 

may be invoked from the measurement template window. For example, when the mouse cursor is over a the 
graphical representation of a measurement operator in the template window, it may change from an arrowhead 
appearance to a measurement operator symbol (e.g. a distance or an angle symbol), denoting that the associated 
sub-graph in the measurement dependency graph may be activated by pressing the mouse cursor. 

40 • or methods affecting the graphical behaviour of the measurement methods in the stencil and the radiological image 
may be steered by the internal methods or the internal control flow (e.g. a graphical entity in the stencil highlights 
when the corresponding node in the measurement dependency graph is visited). 

[0031] In one embodiment a measurement scheme is selected from a measurement stencils repository. A measure- 
rs ment stencils repository comprises a number of measurement stencils. The selection is preferably performed in cor- 
respondence with the examination type and/or the radiographic exposure conditions. 

[0032] The measurement scheme can be implemented as an active or as a passive measurement scheme. 
An active measurement scheme (also called measurement template) is differentiated from a passive one in that the 
measurement procedure is guided in part or completely by a computerised procedure operating on image data. Guid- 
50 ance may range from simple computer guided sequencing of measurement operations to fully automatic execution 
based on automatically determining landmarks and deforming model contours representing anatomy. 
[0033] The graphical part of the measurement scheme can be implemented as an stencil-overlay on the displayed 
X-ray image. The points and lines of the scheme must then be dragged by the user to the correct anatomical position 
in the displayed image. 

55 [0034] In one embodiment, display of the graphical part of the measurement scheme may be omitted when meas- 
urements are simple and performed routinely on the radiograph. User guidance is effectuated here solely through the 
measurement dependency graph, which may generate the measurement points and objects immediately in the image, 
after which the user is requested to map them to their actual position. An example of such simple measurement is the 
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cardio-thoracic index, which ratio is calculated routinely on thorax AP radiographs. 

[0035] In one embodiment, more than one radiographic image may be displayed and a measurement scheme may 
be activated with more than two associated graphical parts. This configuration is useful for performing 3D measure- 
ments from measurements on a limited number of projections. For example, 3D spinal measurements may be obtained 

5 from locations of anatomical points identified on frontal and lateral radiographs of the spine. A measurement template 
with two graphical parts is activated here; one for each of the projections, and each graphical part guides the user in 
the mapping of the projection point of a certain 3D point in the associated projection images. A measurement point 
node in the measurement dependency graph will compute its 3D coordinates from the locations of the point in the 
respective projections. Likewise, 3D measurement object and operator nodes have 3D methods to calculate the 3D 

10 parameters of the object and the 3D measurement values respectively from the values of their children nodes. 
[0036] Specific features and further embodiments of the present invention are set out in the dependent claims. 
[0037] One aspect of the present invention relates to a computer program product adapted to carry out the method 
of the present invention when run on a computer. The computer program product is commonly stored in a computer 
readable carrier medium such as a CD-ROM. Alternatively the computer program product takes the form of an electric 

15 signal and can be communicated to a user through electronic communication. 

[0038] The method of the present invention is advantageous over the prior art for the following reasons. 

• A first advantage of using a measurement template is the unambiguous and instantaneous indication as to the 
position of the measurement objects in the actual image. That is, the first source of random error in the prior art, 

20 due to a badly or non-defined measurand, is eradicated. 

• In a film-based method or in a generic computerised measurement method in conjunction with a radiological meas- 
urement atlas, repeated focusing of attention back and forth between the atlas and the radiological image are 
needed to locate the points precisely. 

25 Moreover, in the absence of an atlas scheme, the position of measurement objects is not defined and hence 

different users may locate a given anatomical landmark differently. 

In accordance with the present invention, the use of a digital template, especially when displayed in proximity of 
the radiographic image, substantially reduces the effort to locate measurement object points precisely and hence 
reduces intra-observer measurement error (error in repeated measurements of the same quantity performed by 
30 a single user) and inter-observer measurement error (error in repeated measurements of the same quantity be- 

tween different users). 

• In the present invention the measurements are digital in contrast to the analogue measurements of the film-based 
method. The precision of positional location is thus dependent on the image resolution (physical size of a pixel 

35 unit, which typically is around 1 0Ojim for digital detectors). 

• In a specific embodiment measurement errors may be further reduced by the possibility of zooming into portions 
of a radiograph prior to locating a measurement point, and occasionally applying a sub-pixel location algorithm to 
define the position of image points with precision up to a fraction of a pixel unit. 

40 

• Interesting measurement quantities are often derived from basic measurements by calculations that combine many 
measurements into final quantities, or from transformations, filters and fit procedures applied on the measurements. 
In such cases the uncertainty characteristics of the derived quantities can be derived by error propagation. 

^5 • The ensembles of digital measurements laid out in a measurement scheme collectively define a standard manner 
on how the procedure must be performed. Standardisation is advantageous because it enables objective compar- 
ison (e.g. in second opinion gathering). 

• By the use of a measurement scheme the order of placement of measurement objects in the image is fixed and 
50 logical (eventually the order may be customised within the constraint of dependency). Therefore, in the template- 
guided measurement method of the present invention, there is no need to study the measurement scheme in an 
atlas to detect the order in which to place the measurement objects so as to guarantee that all depending objects 
are placed first. This way of operation is fundamentally different from the film-based method, where measurement 
templates may even be absent altogether. Repeatability of measurement procedures, obtained by an imposed 

55 order, enhances throughput of diagnostic evaluation of the radiograph, which is important for clinical departments 

such as emergency radiology and intensive care units. 

• The automatic abnormal value signalling functionality provided by a specific embodiment of the method of this 
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invention, operating instantaneously on measurement values as they become available, makes the necessity su- 
perfluous of having the normative reference tables at hand, such as published in the open literature and meas- 
urement atlases. 

5 • The method of the current invention is particularly suited to implement different measurement schemes in the field 
of paediatric radiology, since measurement templates can be customised to reflect changes in paediatric anatomy 
over time. 

The graphical part of a measurement template will display the measurement points, objects and entities using 
anatomical landmarks corresponding to the patient's age. Furthermore age-specific normative values associated 
10 with the measurement template can be applied. 

• In the field of orthopaedics the invention is particularly useful because instantiated measurement schemes can be 
stored and used for further follow-up after therapy. The graphical part of an older template can be retrieved from 
memory and can serve as a new template for a current measurement. The older measurements can be compared 

15 with the new measurement results to assess evolution of a patient's condition. No confusion as to the manner in 

which the measurement objects and entities were defined is possible. Furthermore, second opinion gathering 
becomes more objective when it is based on the same graphically defined measurement scheme. 

• The method of the present invention is particularly useful in emergency radiology since the measurement scheme 
20 relies on the placement of a set of measurement point only after which the auto-completion of all dependent meas- 
urements is implied and automated so that the procedure lends itself to quick execution. 

This feature is not available in the prior art based on manual measurement based on analogue film measurements 
or computer measurements with a generic measurement tool. 

25 • As it will be clear from the description in the sequel, both repeatability and reproducibility are substantially enhanced 
by the stencil-guided measurement method of the present invention. 

[0039] Repeatability conditions include (a) the same measurement procedure, (b) the same observer, (c) the same 
measurement instrument, used under the same conditions, (d) the same location and (e) repetition over a short period 
30 of time. 

Whereas fulfilment of these conditions is not guaranteed by the prior art methods, conditions (a), (c) and (d) are met 
by the current invention because use of a stencil and programmed methods to define the measurands ensure an 
identical procedure applied under all circumstances. Conditions (b) and (e) are fulfilled because the instantiated meas- 
urands in the image according to the stencil are stored and supplied to other referring clinicians, who only need to 

35 perform a confirming analysis. 

[0040] A valid statement of reproducibility requires specification of the conditions changed. The changed conditions 
may include: (a) principle of measurement, (b) method of measurement, (c) observer, (d) measuring instrument, (e) 
reference standard, (f) location, (g) conditions of use, (h) time. Whereas fulfilment is not guaranteed by prior art film- 
based methods and generic computerised measuring tools, the stencil-based method as laid out in the current invention 

40 enhances reproducibility considerably. In particular, reproducibility conditions (a), (b), (d), (e), (g) are met because the 
definition of the measurands and their determination are fixed by and laid out in the stencil. The stencil-based method 
of the present invention is further invariant to reproducibility conditions (f) and (h), and condition (c) is achieved because 
storage and retrieval of prior instantiated measurement schemes render the need to re-perform the measurement 
scheme superfluous. 

45 [0041] The objective of a measurement is to determine the value of the measurand, that is, the value of the particular 
quantity to be measured. A measurement therefore must begin with an appropriate specification of the measurand, 
the method of measurement, and the measurement procedure. In general, the result of the measurement is only an 
approximation or estimate of the value of the measurand and thus is complete only when accompanied by a statement 
of the uncertainty of that estimate. 

50 Prior art methods such as film-based methods and generic computerised measurements do not cope with the problem 
that neither measurands nor measurement method are defined. 

As a result, the uncertainty of the estimated value of a measurand cannot be determined because (a) a measurand 
must be defined by a standard method of measurement and (b) the implementation of the standard measurement 
method. 

55 in the stencil-guided measurement method of the present invention, both definition of the measurands and implemen- 
tation of the measurement method are prescribed. 

[0042] Specific embodiments of the present invention will be explained with reference to the following drawings. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
[0043] 

5 Fig. 1 generally illustrates the method of the present invention, 

Fig. 2 illustrates the manual mapping of measurement objects according to the geometric specification of the 
measurement scheme, 

Fig. 3 illustrates the ROI-magnified manual mapping of measurement objects according to the geometric specifi- 
cation of the measurement scheme, 
10 Fig. 4 illustrates the automated placement based on deformable contour segmentation. 

DETAILED DESCRIPTION OF THE INVENTION 

[0044] Prior to the description of the flow of operations of the method of the present invention, four different imple- 
15 mentations of measurement scheme will be described: 

as a graphical object, 

as a tree or graph oriented graphical structure, 
as a tree or graph oriented textual structure, 
20 - as a structured document. 

* As a graphical object: 

[0045] In this representation the anatomy is schematically depicted as a collection of outlines of bone and other 
25 radiologically well-manifested landmarks. The measurement objects are drawn superimposed onto the anatomical 
outlines. 

This representation is useful in the course of performing complex measurement procedures since in this implementation 
the position of the measurement points is displayed with respect to the anatomy of the patient. 
Fundamental to the representation as a graphical object is that this representation graphically depicts the spatial re- 
30 lationship between anatomical features and measurement objects. 

The main advantage of this view is that it enables the user to define user points unambiguously. Hence this represen- 
tation enhances the precision of the measurement procedure (i.e. the error that would result on the measurements 
when performed repeatedly by different radiographers). 

Significant spatial relationships for two dimensional (plane) images can be defined for example (analogous relations 
35 can hold in three or more dimensions) between points, a point and a line (more general a point and a curve), a point 
and an area, between lines, line-area, between two areas, etc. Examples of relationships are incidence, betweenness, 
containment, etc. 

[0046] For example, the center line of the femur bone, which is a 3D volume, may be defined on the basis of two 
points, each of which are exactly in the middle between a pair of juxtaposed points on the femur contour. The circularly 
40 shaped femur head may be described by a circle segment fitted only the femur head edge pixels (circle-contour inci- 
dence). 

* As a tree or graph oriented graphical structure 

45 [0047] The main advantage of this representation is the ability to view the dependencies between measurements, 
and thus the implicit order of performing the actual measurements. 

Measurement entity sharing, the term used in this context to denote the use of a measurement entity by more than 
one super entity, is also expressed in the graphical structure. 

When one or more entities are shared by more than one super entities, a dependency graph is obtained, whereas in 
50 the absence of sharing, a dependency tree results. 

Obviously, measurements that depend on others can only be performed or calculated when the latter have been done. 
The procedural nature implied by this representation is an advantage because it guides the user and formalizes the 
measurement. 

In the prior art, it was the user's task to analyze and extract the right order from a published measurement scheme, 
55 which is time-consuming and error-prone. In the absence of a guiding scheme, measurements performed at a given 
point in time may become invalid when depending measurements were erroneously skipped over. 
[0048] A measurement scheme will typically have more measurement results as outcomes. Each measurement 
result is represented by a graph, or a tree when there are no cycles, i.e. no shared measurement entities. A collection 
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of disconnected trees is called a forest. 

[0049] Though the definition of a tree implies no direction on the edges, a tree is usually drawn with the root at the 
top and the direction is from top to bottom. The root node represents the highest-level measurement entity, usually 
having a diagnostic meaning, a name according to the medical nomenclature and possibly an associated normative 

5 values table. The children of the root node represent constituent measurement entities such as points, lines, circles 
etc. Each of these nodes may in turn depend on still other measurement entities. The bottommost terminal points in a 
tree are called leaves. Because the most primitive user interaction by means of which anatomical points are indicated 
in the digital image is a mouse pointer click, all leave nodes graphically represent points (at pixel or sub-pixel locations) 
and all other graphical objects such as lines, circles or curves will ultimately be determined by user-defined points or 

10 calculated points. 

[0050] All nodes are collectively called measurement entities. Each node basically falls into one of two types: 

• measurement operator 

The measurement operator performs a measurement operation. This type is further subdivided according to the 
*5 type of resulting quantity. 

Pure measurement operations 

Pure measurement operations have measurement objects as their arguments and produce physical quantities 

such as distance, curvilinear length, angle, area, volume etc. as a result. 
20 For example, in radiography, the heart volume in a neonate is calculated as V = F • A • B • C, with A,B and C 

perpendicular axes of an ellipsoid inscribed in the cardiac silhouette on AP and profile radiographs, and Fa 

factor including both the ellipsoid formula constant and the magnification factor, and further being dependent 

on patient specific data such as age and weight. 

Arithmetic measurement operations 
25 Arithmetic expressions operate on measurement objects and result in (clinical) indices such as ratios between 

distances (e.g. cardio-thoracic index), ratios between areas (e.g. ventricle-brain ratio) etc. 

For example, the cardio-thoracic ratio is defined as C/Twith Cthe width of the cardiac silhouette at its greatest 

extentto the right and left of the spine, and Tthe inner width of thethoracic rib cage measured at different levels. 

In this category fall complex arithmetic relationships expressed by a nomogram in the prior art. For example, 
30 the calculation of the body surface area and the assessment of gestational age from lumbar spine dimensions 

are based on nonlinear relationships of the constituent measurements or parameters. The graphical evaluation 

of the nomogram is emulated electronically in the present invention. 

• measurement object 

35 a measurement object is a geometrical object that can be depicted graphically, and that has physical or ana- 

tomical support. In informatics terms, measurement objects are instances of a class. 
The following classes are particularly relevant: 

- Point 

40 a point represents a location in space, on the image and on the stencil drawing, and has no width, height or 

depth. 

Measurements based on points must adopt a convention for locating the pixel's origin. Because each pixel 
has a certain size, the point represented by a pixel can be either the center of the pixel's square, or one of the 
corners of it. 

45 The point class is further subdivided in 

User-defined points (Upoints) 

These points must be drawn on the screen by the user either by a mouse pointer, or other digital input 
means such as a graphical tablet e.g. 

50 - Derived points (Dpoints) 

These points are needed in the course of the measurement procedure but in contrast to user-defined 
points, derived points are the result of geometrical calculation based on available graphical objects. Ex- 
amples are the intersection of two lines, the intersection of a line and the perpendicular of a line through 
a given point etc. The procedures to locate a certain point as a geometric locus are defined in the methods 

55 of the point class. 

All other measurement objects in the digital image are ultimately based on points, either user-defined or 
derived. 
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Line 

A line is a graphical object in 3D space with indefinite length and no breadth. A straight line is the shortest 
distance between two points in 3D space and is commonly referred to as "line". For two-dimensional images, 
we consider the projections of 3D lines in the image plane, which are also lines. In its simplest form, a line 
5 may be specified by drawing two points, each point drawn independently according to methods outlined in the 

point class. Alternatively, a line may be derived according to properties of other graphical objects (e.g. tangent 
and perpendicular orientation). Finally, a line may be calculated on the basis of a plurality of image points such 
as edge pixels by a fitting procedure. 

A line segment is specified by limiting the extent of a line between interval bounds. 
10 Compound linear objects such as triangles, quadrilaterals, regular and general polygons are classes based 

upon the line class. 

The line class specifies the methods how the line is determined in the image. 
Analytic Curve 

15 This class contains graphical objects that are generated in the image by evaluating an analytic equation. This 

class is also called parametric curve class. Two types of analytic curves deserve special attention in the context 
of a diagnostic measurement tool: 

• Circle 

20 A circle is a closed curve, all points of which are the same distance from a point called the center. The 

center point may be drawn according to one of the methods specified in the point class. The radius may 
be specified by drawing another point on the circle's circumference. Also, three non-collinear points, each 
drawn independently according to methods outlined in the point class, uniquely define a circle. Alterna- 
tively, a circle may be specified according to properties of other graphical objects. Finally, analogous to a 

25 line, a circle may be calculated on the basis of a plurality (more than 3) of image points, such as edge 

pixels, by a fitting procedure. 

A circular arc is specified by limiting the circumference of the circle between angular bounds. 

• Ellipse 

An ellipse is generated by a point moving so that the sum of its distances from two points (the foci) is 
30 constant and equal to the major axis. The ellipse object is important in planar images because the parallel 

projection of a circle in 3D space is an ellipse. Metallic rings (e.g. embedded in the liner of a sphere- 
shaped cup prosthesis to make its outline and orientation visible in the image) with a certain 3D orientation 
project in the 2D image plane as ellipses. 

Again, as for all graphical objects having analytic description, ellipses may be calculated on the basis of 
35 a plurality of image points such as edge pixels by a fitting procedure. 

• Polynomial curves 

Polynomial curves such as a parabola have clinical utility in measurement schemes as well. For example, 
the outline of corresponding anatomical landmarks on the spinal process may be fitted with a polynomial 
of degree sufficient to make a least-squares fit error lower than a pre-defined threshold. Pathological 
40 displacements with respect to the mean curve of one or more vertebrae may then be detected by imposing 

a suitable threshold on the standard deviation (typically 2... 3 SD). 

Pseudospondylolisthesis and spondylolisthesis, which are manifested by a forward shift or bulge of a 
vertebra, over the edge of the one below it, may be assessed likewise. A curvature measure, computed 
on the basis of a fitted polynomial, may be used to quantify kyphosis or lordosis spinal deformity. 

45 • Bezier and Spline Curve 

Curves in 2D and surfaces in 3D with a more complex shape may be described by piecewise polynomial 
subdivisions of a desired object shape, each of the curve segments defined by a control polygon and a 
basis of interpolating blending functions to establish the relationship between the curve and the control 
polygon. The control polygon forcubic (3 rd degree) splines consists of 4 points which may either be defined 

50 by methods outlined above, or may be derived on the basis of least-squares fitting. Of particular interest 

is the approximation of an object shape in the image with a fitting Bezier or spline shape based on the 
edge points of the object. Distance of an open-ended curve may be computed as the curvilinear path 
length defined as the path length integral between 2 points lying on the curve. An angle between two lines 
tangent to the curve at a two points, may likewise be calculated based on the derivatives of the curve's 

55 analytic function. 

[0051] Because the result of a measurement scheme is a quantity, the root node type is always a measurement 
operator (either pure or arithmetic). 
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[0052] The arity of the nodes of a tree will generally depend on the complexity of the measurement. Measurement 
operators such as distance or angle involve two operands (e.g. the distance between two points, between a point and 
a line, the angle between two lines etc.). Arithmetic expressions based on measurements can also be expressed by 
or converted to a tree having binary nodes only. These binary arithmetic trees are also called a parse trees, and are 
5 constructed from expressions in either parenthesized infix or postfix (reverse Polish) notation. 

[0053] The arcs between a node and its descendants (children) denote the relationship between them. For meas- 
urement operators, the relationship refines the arguments; for measurement objects, relationship can be read from the 
descendant node (children) towards the depending node (parent). For example: 

10 ■ the binary measurement operator "angle" subtended between two lines may be described as: 
angle (from line, to line) and the relationships are from (first line), to (second line) 

■ the intersection point between two lines is described as the point that is the geometric containment of both lines: 
intersection (containment line, containment line) 

The term "intersection" is used here instead of the more general object name "point". The relationship can be read: 
15 the line contains the point. 

■ a circle may be defined by three point coincident on it: 

circle (incident point, incident point, incident point). The relationship can be read: the point is incident on the circle. 

■ the perpendicular distancefrom a given pointto a given line is computed by first calculating the intersection between 
the given line and the perpendicular onto that line, and next calculating the distance between the given point and 

20 the intersection point 

■ ratio (nominator measurement operator, denominator measurement operator) and the relationships are nominator, 
denominator: 

ratio (nominator operator, denominator operator), and each of the arguments is the result of a measurement op- 
eration 

25 

[0054] Specification of the method of computing the object of a node may be intrinsically or extrinsically. The leave 
nodes, representing points in the image, are generally computed by a method based on internal parameters of the 
nodes only. In passive measurement templates, for example, the points may be defined by pixels designated by the 
user via the graphical user interface. 

30 Definition of the relationship enables a node to perform its computation of the value of the node. In the example given, 
when two lines each have a relationship of containment of a point, the method of computation of the intersection point 
is invoked and the result is passed to the higher-level nodes. When the relationships between a point and a line with 
a desired line are one of incidence and perpendicularity respectively, an algorithm that computes of the perpendicular 
line through a point onto a line is performed. 

35 For active measurement templates, the leave nodes of the measurement dependency graph represent groupings of 
pixels, belonging to an anatomical contour, and the method of computing these pixels is specified by an edge detection 
and linking algorithm. The depending node will subsequently perform a model-based deformable contour segmentation 
on the basis of edge and region based features, mapping the instantiated model contour onto the anatomical data. 
The output of such a node is one or more points, representing requested measurement point(s) mapped to its corre- 

40 sponding position in the image. 

* As a tree or graph oriented textual structure 

[0055] This representation is particularly suited to perform customization of existing measurements, or to create 
45 measurement schemes from scratch. A two-pane view can be used for this purpose. The left pane displays the trees 
making up the measurement scheme(s). To convey dependency structure, each sub-level of the tree is indented with 
respect to parent level. Each node of the tree has an associated flag indicating that the underlying sub-tree is either 
contracted (flag is a "+" sign, indicating that the node has children that currently are invisible but may be viewed by 
pressing the flag button, upon which the flag turns into a "-" sign) - or expanded (flag is a "-" sign, indicating that the 
50 node's children may be hidden by pressing the flag button, after which the flag turns into a "+" sign). Customization 
proceeds by copying subsets of measurements from an existing scheme (or a number of schemes) to a new scheme 
by mouse-dragging the top-node of a sub-tree from the left pane to the right pane. Alternatively, a copy-paste sequence 
(CTRL-C / CTRL-V key strokes) may be used. To refine the resulting measurement tree(s) in the right pane, individual 
measurements may either be deleted, or added by drawing them from a generic measurement toolbox. 

55 

* As a structured document 

[0056] In this representation, individual measurements, collections of measurements and measurement dependen- 
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cies are stored in a document comprised of information entities. Layering type and structure of the information is en- 
coded according to a generally adopted standard such as the XML (Extensible Mark-up Language) recommendation 
for example. The main advantage of this type of information storage is the universal exchangeability of measurement 
schemes and associated measurement data. The declarative nature implied by this representation is advantageous 

5 for subsequent operations such as storage and archiving, abnormal value signaling, and data mining. The structured 
document representation also lends itself for customization of templates. Custom-made measurement schemes may 
be built from scratch, by performing measurement drawn from the general measurements toolbox, and finally saving 
the resulting procedure. Likewise, an existing measurement stencil can be modified by adding measurements from 
the general measurements toolbox or omitting measurements (both subject to conditional dependencies) and saving 

10 the result as a new template. A third way of customization consists in that a new template may be constructed departing 
from two existing complete measurement templates by matching and merging their XML trees (or sub-trees) according 
to a set of merging rules operating on individual nodes such as updating, adding, deleting and moving nodes or ag- 
gregated nodes (sub-trees) such as sub-tree graft (inserting a sub-tree), sub-tree prune (deleting a sub-tree), sub-tree 
move (moving a sub-tree). Node equality comparison may be based on matching of node ID's or the node tag name 

15 and content. Prior art for merging trees may be used to this purpose such as the IBM Alphaworks 1 XMLTreeDiff and 
XMLDiff ("XML Diff and Merge Tool"). More than two templates may be merged by iterating this procedure. 
[0057] The following is a description of the flow of operations when passive measurement templates are used. 
[0058] After the digital image has been acquired and displayed and the measurement template has been selected, 
a geometrical mapping process is invoked to request the user to place all measurement objects in the image whereupon 

20 the corresponding position in the image is entered into the computing system. 

[0059] Depending on whether or not image data or image-derived data are used in the process of locating the meas- 
urement objects, a measurement template is termed either active or passive. 

[0060] In a passive measurement template all measurement objects are placed manually in the displayed image. It 
is the user's responsibility to locate all measurement points in accordance with the measurement template sketch 

25 displayed simultaneously and in close vicinity with (or superimposed on) the radiograph. 

[0061] When using passive measurement templates, two embodiments of user-system interaction may be consid- 
ered depending on the way in which the internal informatics model of the measurement template is activated. 
[0062] In one embodiment, all user-requested measurement points are mapped priorto generating the measurement 
objects that depend on them. All measurement objects are highlighted on the digital sketch upon which a copy of the 

30 object is generated and the user is requested to drag and adjust the copy to its corresponding position in the actual 
radiographic image. When all measurement points are available, the depending measurement objects are generated 
and the result of the measurement operators is computed. 

[0063] This mode has the advantage that it enables quick execution of the measurement template because all user- 
interactions are concentrated in a single pass. 
35 it has the disadvantage that fewer insight is gained how the template has built up the measurements. Also, eventual 
errors in locating individual points are less easily discerned and corrected. 

[0064] In a second embodiment, the measurement objects are generated when all points defining them are available, 
and likewise, the result of measurement operators may be computed when all required objects are known. 
This mode has the advantage that the user has close control over the measurement procedure as it is constructed 
40 gradually, which is especially advantageous for complex measurement schemes. In the occurring event that the user 
establishes the current object wrongly, he/she may re-position the underlying points, without affecting the rest of the 
procedure. 

It has the drawback that superposition of too many lines and mark-up in the course of the procedure may prevent the 
user from accurately positioning the remaining points. 
45 [0065] When a measurement operator node is addressed in the internal model of the passive measurementtemplate, 
the measurement value is calculated. The calculated data may be corrected on the basis of calibration data derived 
from calibration objects in the image (such as a ruler). 

[0066] Furthermore, based on the measurement dependency graph, errors can be propagated to provide an estimate 
of measurement uncertainty. 

50 [0067] At the time of processing a measurement operator node, a process can be initiated that selects the normative 
value associated with the anatomical quantity produced by the measurement operator node in the given template. 
The proper identifier and patient data are sent to a normative values repository, and the raw normative reference and 
its semantics are retrieved. 

Normalisation is performed when needed, for example to express the acceptable range to the commonly used 2-sigma 
55 range, or to a user customised range when the standard deviation is retrieved, or to perform the nomographic look-up 
procedure when normative values are encoded in nomograms. The final normative values are applied to the result of 
the measurement operator, and normality/abnormality is messaged. 

[0068] The result of measurement operators and their associated uncertainty bounds can be displayed textually in 



11 



EP 1 349 098 A1 



a measurement values window, and depicted graphically using suitable mark-up produced by an automatic dimension- 
ing process. Likewise, normal values can also be displayed textually and depicted graphically, to enable clinical as- 
sessment of the normality/abnormality of the measurement value in relationship to its uncertainty. 
[0069] Two modes may be considered when using a passive measurement template: manual placement mode and 
5 enhanced placement mode. 

[0070] In the manual placement mode all constituent points required to derive a given measurement object are placed 
manually in the image by dragging the mouse pointer until it is over the anatomical location of interest and clicking the 
mouse or a key to fix the position. Portions of the image may be zoomed out to define the point's position to within 
pixel unit precision. 

10 [0071] The enhanced placement mode is achieved by hinting the user as to the position of a constituent point of a 
measurement object by confining the placement to a set of points or objects defined by the graphical construction 
defined so far. These set of geometric objects are called the geometric loci of a geometric problem. 
When the mouse cursor is moved, that point of said set, which is closest to the mouse cursor, is highlighted along with 
its property with respect to the measurement object being drawn (e.g. it is a tangent point, perpendicular point, center 

15 point, end point, topmost point, leftmost point, inflection point etc.). 

If the user accepts the suggested point, he or she presses the mouse button, even when the cursor is not exactly over 
that point, and the mouse cursor will immediately jump to it. 

This mode is also called snap placement mode, and makes it possible to exactly pick out the location of a given point. 
Obviously, because analytical expressions of measurement objects enable exact geometrical solutions, the geometrical 

20 measurement precision is substantially enhanced in this mode. 

Setting snap to lines or other graphical entities has a similar effect: e.g. the line tangent to a circle (there are two such 
lines) through a given point is selected when moving the cursor nearest towards the intended tangent point, and a 
mouse click will teleport the cursor onto that tangent point on the circle, after which drawing of the tangent line completes 
the drawing of the line measurement object. 

25 When the set of attractor points contains only one point, the drawing action completes without any further user inter- 
action. 

This auto-completion property is made possible because the measurement template names each measurement object 
(according to medical nomenclature), and the measurement scheme uses the name of objects to uniquely designate 
each of them. 

30 [0072] For example, suppose that three lines have been drawn in the image, named A, B and C, and a fourth line D 
needs be drawn through a point p perpendicular to line B. 

Line Dean be drawn immediately after placing point p, because of all three possible perpendicular intersection points, 
the intersection point with line B is the target point. 

Without naming of objects, the user would be faced with three possibilities in this example. 
35 When multiple snap objects still exist, such as in the case of a line through a given point and tangent to a circle, the 
user must resolve the intended point by moving the cursortowards it (which will invoke highlighting of it) and completing 
the editing by pressing the mouse. 

Enhanced measurement precision and faster measurement completion are the main advantages of this mode 
[0073] Defining objects based on attractor or snap objects is different from active measurement objects, to be defined 
40 further, because they are geometric loci, based on and calculated with the internal descriptions of the graphical meas- 
urement objects (e.g. equations of line, circle...) whereas active measurement objects get theirfinal position and shape 
based on image or image-derived data. 

[0074] The following is a description of the flow of operations when active measurement templates are used. 
[0075] Also in this embodiment the digital image that has been acquired is displayed. Then a measurement template 
45 is selected and a geometrical mapping process is invoked to request the user to place all measurement objects in the 
image whereupon the corresponding position in the image is entered into the computing system. 
When image data and/or image-derived data are used in the process of locating the measurement objects, the meas- 
urement template is termed active. 

[0076] In contrast to the passive measurement template, the geometrical mapping process for active measurement 
50 templates is based on automatic landmark, feature and object locating by applying suitable image processing operators 
and algorithms. 

[0077] These algorithms assume that the location of the measurement points may be modelled either directly or 
indirectly. 

In direct modelling the measurement point is specified in terms of a local pre-defined configuration of grey value char- 
55 acteristics. In indirect modelling it is assumed that a set of measurement points may be defined in spatial relationship 
to an anatomical shape of which representative models (either 2D or 3D) have been built that are mapped in the image 
(either 2D or 3D). In 2D images, models may typically take the form of collections of open-ended or closed curves. In 
3D images the models may take the form of surfaces. 
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[0078] Initialisation comprises the mapping of anchor points in spatial relation to which the initial position of the 
instantiated model contours will be positioned. 

The initial pose and shape of the model contours is adapted according to the spatial disposition of the anchor points 
in the image. 

5 Pose comprises the translation, orientation and size (i.e. position of the origin point of the instantiated model contour, 
orientation of an axis of the contour relative to the orientation of lines connecting the anchor points, and the applied 
magnification). 

Shape comprises size and initial form of the contour, which may be expressed by a transformation matrix calculated 
on the basis of the anchor points of the model space and the corresponding anchor points located in the image. 
10 [0079] For example, two points in a plane define an Euclidean similarity transformation (translation, rotation, scale) 
in that plane, three anchor points (forming a triangle) define an affine frame (translation, rotation, scale and x and y 
shear), four anchor points (forming a quadrangle) define a projective frame (translation, rotation, scale, x and y shear 
and projections). 

On the basis of the computed transformation parameters, the initial curves representing anatomical entities are instan- 
ts tiated in the image, or the regions of interest around anatomical landmarks are mapped in the image. 

Initialisation further comprises setting suitable parameters for the segmentation such as parameters for the internal 
and external forces of snake deformation (i.e the coefficients of elasticity, rigidity and the weight associated with the 
image data). 

[0080] An image processing procedure subsequently calculates the precise segmentation of anatomical entity con- 
20 tours or anatomical landmarks on the basis of image data only. 

[0081] Measurement objects, the definition of which is determined in relationship to the delineated anatomical ge- 
ometry, are computed and drawn superimposed on the segmentation. 

The user is prompted to accept the segmentation and landmarks, and the computed measurement objects. In the event 
of mal-positioned objects, the procedure is re-iterated with user-adapted initial parameters. 
25 [0082] The remainder of the flow of operations in an active measurement template is identical to the flow based on 
a passive measurement template. 

[0083] Mixed measurement schemes may be constructed and effectuated also, where measurement objects are 
located by combining manual mapping of the anatomical points with automatic point mapping based on contour and 
region segmentation of some anatomical entities that have linked the required points into their representation. 
30 [0084] The following is a general overall description of an embodiment of a procedure for performing a digital stencil 
guided measurement according to the present invention. The constituent method steps are explained in detail. 

• Image acquisition and display 

35 [0085] A digital image representation of an image onto which geometric measurements are to be made is acquired. 
[0086] A large variety of image acquisition systems are applicable. The radiation image can for example be recorded 
on a photo-stimulable phosphor screen. The screen carrying the radiation image is then read out by scanning it with 
stimulating radiation, detecting the image-modulated light which is emitted upon stimulation and by converting the 
image-wise modulated light into a signal representation of the radiation image. 

40 [0087] In an alternative embodiment the radiation image is stored in a direct radiation sensor rendering a signal 
representation of a radiation image. 

[0088] Still further alternatives for acquiring a digital signal representation of a radiation image, such as scanning of 
radiographic film carrying a radiation image, are possible. 

[0089] It will be clear that the image representation may also be retrieved from an image database, e.g. part of a 
^5 ris (radiology information system) or HIS (hospital information system) or PACS (picture archiving and communication 
system). 

[0090] The acquired image representation is next applied to a display device connected to a computer and the image 
is displayed. 

50 • Template retrieval and display 

[0091] The measurement template is selected from a measurement stencil repository stored in the computer. 
[0092] The selection is preferably made according to the examination type, imaging parameters and patient specific 
information. 

55 The examination type determines the anatomical part imaged. Imaging parameters such as angle of incidence, distance 
between radiation source and patient and resolution are important selection criterions. Age and gender may also affect 
anatomical appearance of body organs. 

[0093] The selected template is retrieved, loaded and activated in the system. 
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[0094] In one embodiment this involves: 

Activation of the measurement dependency graph and registration of all needed measurement methods for the 
constituent measurement points and measurement objects, 

5 - Generating a graphical representation of the measurement template displayed in close vicinity of the radiographic 
image. Associated with the graphical representation, a structured document frame is generated. The document 
frame holds a description of the graphical layout of the measurement scheme in the current image in a universally 
exchangeable format such as SVG (Scalable Vector Graphics, which is a language for describing two-dimensional 
vector and mixed vector/raster graphics in XML). In this document frame all actualised graphical parameters of 

10 the measurement objects and entities will be stored. 

Generating the measurement values window displaying the medical nomenclature of all measurands in the 
scheme, and a set of numerical values pertaining to the measurement. This set comprises the actual measurement 
value and units, an applicable calibration factor, the normative reference value if one is provided, and an abnor- 
mality-alerting box. Associated with the measurement values window, a structured document frame is generated 

*5 holding a tagged description of the measurement scheme in a universally exchangeable format such as XML 

(Extensible Mark-up Language), and into which all measurand-specific measurement values will be inserted. 

• Locating measurement points 

20 [0095] The measurement template has the purpose of defining the measurands with respect to the anatomy and of 
defining how the constituent points, defining a measurand, are to be placed in relationship to the anatomy 
[0096] In the described embodiment of the present invention, three placement modes are described: manual place- 
ment, ROI magnified placement, automated placement based on deformable contour segmentation. 

25 1 . Manual placement (fig. 2) 

[0097] In this mode, all points are placed manually in the image by cursor clicks. 

In this embodiment the measurement template imposes the placement order by highlighting each point in sequence 
(e.g. by blinking the point in the template). 

30 Following this order ensures that at any point in time, the system knows which measurement object is being defined 
by virtue of its definition in the template, and hence which measurement objects and mark-up are to be generated next 
or which measurement entities may be computed next because of availability of all constituent points of the measurand. 
This auto-completion feature is possible because the dependency graph of the measurement template defines how 
measurement objects and entities are computed on the basis of existing objects. 

35 This property is not available in generic measurement tools of the prior art. 

[0098] Alternatively, completion of objects and entities of higher layers may be deferred until the user determines all 
points of the bottommost layer. This alternative embodiment has the advantage that no graphical display of auto- 
generated objects and entities will obscure the precise placement of subsequent points, which is particularly useful 
when complex measurement schemes need be performed. 

40 [0099] Alternatively, image data and measurement mark-up may be organised and stored in different layers into 
computer memory, the display of which is turned on and off depending on the current action being performed. For 
example, when the user is positioning points, the display of any unimportant graphics may be turned off. 

2. ROI-magnified placement (fig. 3) 

45 

[0100] In this mode, measurement points are placed more accurately in the image by magnifying a region of interest 
(ROI) box around the measurement point. 

Each measurement point has an associated ROI, which is an image region covering a particular body part or joint, and 
wherein the measurement point is contained. 
50 a ROI may contain a set of measurement points if all of them have similar anatomical semantics and are optimally 
determined simultaneously. 

For example, one single ROI covering the femur head is used to locate three separate points sampled identically and 
approximately equidistant along the femur head's contour and collectively approximating the circularly shaped femur 
head boundary. 

55 [0101] In the described embodiment, in order to determine the image ROI corresponding to a measurement point, 
the portion of the image around the mouse cursor is magnified constantly as the mouse is moved over the image, the 
size of said image ROI being determined by the measurement template. A mouse cursor clickfreezes the magnification 
around the current mouse position when the operator believes the ROI is covering the image region containing the 
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desired measurement point. The point editing is completed by a second mouse click at the anatomical image location 
of the measurement point. As the magnification enables to view image data to pixel-level resolution, individual pixels 
may be selected unambiguously. 

[0102] An alternative for speeding up the determination of the image ROI's is the semi-automated position of ROI's 
5 relative to a few user-defined points, the position of which is anchored with respect to the anatomy as depicted in the 
measurement template. 

[0103] Anchor points are sets of points in the template, which have specific anatomical meaning, which are easily 
locatable, and which are few in number yet enable full location of all ROI's. 

In a full-leg examination, eligible points are the bony landmarks corresponding to the greater trochanter, the femoral 

10 intercondylar notch and the upper ankle joint center. 

Because each ROI has sufficient extent and its location around the measurement point in the image allows certain 
positional variation, mild positional variation of the anchor points is tolerated as well. The position of previous meas- 
urement points inside their associated ROI's may refine the position of ROI's of subsequent measurement points. 
[0104] A portion of the graphical measurement stencil around the measurement point may be magnified also to better 

15 view the point's relationship to the depicted anatomy. The measurement template encodes the precise boundary of all 
ROI's around their measurement point(s). 

[0105] The zoomed portion of the image corresponding to the ROI maybe placed either inside the image, at a position 
centered around the mouse cursor, or alternatively in a separate zoomed image data window. 
[0106] Analogous to the manual placement mode, generating the graphics and mark-up of measurement objects 
20 and entities may be deferred until the position of all points of the bottommost layer of the dependency graph of the 
measurement template have been determined in the image. 

3. Automated placement based on deformable contour segmentation (fig. 4) 

25 [0107] In this mode, no direct placement of measurement points is required. Instead, the position of measurement 
points is defined in relationship to contour models representing patient anatomical entities. 

[0108] Hence, the position of measurement points and objects is indirectly specified by their associated position and 
local features on an instantiated and subsequently deformed model contour. 

Examples of the relationship of desired measurement points may be incidence (of the measurement point on the 
30 contour), midpoint (with respect to pairs of specific locations on the contour), and barycenter (with respect to configu- 
rations of specific point locations on the contour). 

Examples of the relationship of desired measurement lines may be fitted tangent line (with respect to a specific location 
on the contour), symmetry line (with respect to juxtaposed segments of contour pixels). 

Examples of the relationship of desired measurement curves may befitted circle arcs (with respect to specific circularly 
35 shaped segments of the contour), and fitted parabola's or higher order polynomials to extremal points of groups of 
contours. 

Automatic placement and deformation of the instantiated model contour(s) can be based on automatically segmenting 
the bony outlines based on Point Distribution Models (PDM) and Active Shape Models (ASM). This segmentation 
principle can for example be applied to individual vertebrae of the spine, the hand and the hip. 
40 [0109] The initial position of the instantiated model contours can likewise be based on a small set of anchor points, 
relative to which the initial pose (translation, rotation, scale) of each instantiated contour is determined and further be 
adjusted according to affine or projective transforms. Alternatively, object recognition techniques may be used to locate 
the anatomical site corresponding to the model contour. 

^5 • Chaining of measurement operations 

[01 1 0] The computation of measurement objects and measurement entities follows an execution flow as determined 
by the order of visiting the nodes of the dependency graph. 

The bottommost level contains points only, of which the determination of their position is requested from the user. 
50 Levels above the bottommost layer contain measurement objects and entities that build upon these user points. 

[0111] Prior art is used to traverse the measurement dependency graph. Because all measurement points must be 
determined first, prior to being able to execute the parent nodes, the visiting order is: 

"visit the left subtree, then visit the right subtree, then visit the root", or equivalently, "visit the children, then their parent 

(s)". 

55 This is a postorder graph traversal, based on a stack data structure to store the nodes. From a point of view of calcu- 
lation, this is a demand-driven data flow network, because a node can only be computed when all data, required in its 
computation, are available. 
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• Derivation and drawing of measurands and measurement mark-up 

[0112] Based on the measurement point's coordinates in the image, the measurement objects (lines, circles, parab- 
ola's etc.) are generated using methods that are widely known in computer graphics. 

5 

• Calculation and display of measurement values and uncertainties 

[0113] The calculation of the measurement operator values, such as distances and angles, are based on the geo- 
metrical location of the measurement objects in the image and are computed following principles of geometry. 
10 [0114] In this embodiment the raw value obtained from the image-based location of the measurement objects is 
corrected using calibration factors. 

E.g. magnification and pixel size are basic calibration factors to convert pixel distances to physical distance. 

Raw values, correction and calibration factors, and physical measurement values are tabulated and displayed in a 

measurement values window. 

*5 [01 1 5] Measurement entities such as linear and angular dimensions are represented in the radiographic image using 
graphical mark-up. Dimensions include dimension text, dimension lines, extension lines, and arrowheads. Type and 
appearance of dimensions may be customised to user preferences. 

[0116] Measurement values may be displayed either discretely or continuously in the measurement values window 
as the user moves the position of a point over the image. 
20 in the discrete mode, the values are updated after user control is released (e.g. the user stops dragging the mouse 
cursor and releases the mouse button when he/she believes the measurement point is well located in the image). 
In the continuous mode, the values are adapted continuously during moving the measurement point in the image. This 
mode has the advantage that the abnormality alerting mechanism, described in the sequel, is continuously calculating 
whether some measurands are outside their normal range in response to repeatedly moving the measurement point 



When a measurand is on the threshold of abnormality, the abnormality signal will start toggling, alerting the physician 
that care must be exercised, and more confidence will be gained in the outcome of the measurement when finally the 
mouse cursor control is released on a considered position in the image. 

[0117] Measurement results have some inherent uncertainty because the measured result is only an estimate of the 

30 "true" or "correct" value. To establish this relationship between the measurement and the true value of the measurand, 
the contributors to uncertainty in the measurement are established. In most cases a measurand Vis not measured 
directly, but is determined from a number N of other quantities X A ,X 2 ...X N through a functional relationship f : Y= f(X A , 
X 2 ...X N ). The input quantities upon which the output quantity Ydepends may themselves be viewed as 

measurands and may in turn depend on other quantities as expressed by the measurement dependency graph. In the 

35 context of the present invention, the measurands and depending measurands are based on the determination of points 
in the image, and therefore, the measurement uncertainty will be a complex relationship f of the uncertainty in pixel 
location. An estimate of the measurand Y, denoted by y, is obtained from the functional relationship fusing input 
estimates x^,x 2 ...x N tor the values of the N quantities X] ,X 2 ...Xpj. Thus the output estimate y, which is the result of the 
measurement, is given by y = 1[x A ,x 2 ...x N ). Each input estimate x t and its associated standard uncertainty u(xj) are 

40 obtained from a distribution of possible values of the input quantity X f . This probability distribution may be either fre- 
quency based, that is, obtained from a series of k observations of X h or it may an a priory distribution. These types 
are referred to as Type A or Type B evaluations of standard uncertainty respectively. For example, assuming a linear 
resolution dx of the image, the value of a pixel determination process that produces a given location X can lie with 
equal probability anywhere in the interval X - dx to X + 8x and the process is described by a rectangular probability 

45 distribution of width 5x with variance u 2 =(5x) 2 /1 2 implying a standard uncertainty of u^0. 295* for the linear position of 
any pixel in the image (referred to as Type B evaluation of standard uncertainty). The standard uncertainty of y, where 
y is the estimate of the measurand Vand thus the result of the measurement, is obtained by appropriately combining 
the standard uncertainties of the input estimates X^ ,X 2 ...Xfl. This process is called error propagation. 
[0118] The square of the combined uncertainty u c (y) for independently assumed input quantities and sufficient lin- 

50 earity of fat the x t is given by 



the partial derivatives to X t being evaluated at x t called the sensitivity coefficients. For correlated input quantities, the 
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expression for the combined variance u (y) associated with the result of a measurement is 



5 "?O0=£ L Y ¥~ u ( x i> x j) = H L ¥~ T~ u ( x * J » X J 

i= l j=i dx i dx j i=i j=i dx i dx j 

with u{x h x,)=u(Xj)u(Xj)r(x h Xi) the estimated covariance associated with x,-and x y -and the degree of correlation between 
10 x,-and x y - characterised by the estimated correlation coefficient #tx /? Xy). Although u c (y) can universally be used to express 
the uncertainty of a measurement result, in the context of a medical application, a measure of uncertainty is given that 
may be expected to encompass a large fraction of the distribution of values that could reasonably be attributed to the 
measurand. The expanded uncertainty denoted by U is computed by multiplying the combined standard uncertainty 
u c {y)by a coverage factor k: U = ku c (y) and the result of the measurement is expressed in the measurement values 
*5 window as Y=y±U. Usually, k is set to 2, meaning the uncertainty is denoted at a 95% (2SD) confidence level. 

[0119] The uncertainty bounds of a measurand may also be depicted graphically in the image by additional lines 
drawn at either side of the measurement mark-up line of the measured quantity in its associated graphical layer. 



20 



• Retrieval of normal values and comparison with measurement values 



[0120] After selection of a measurement scheme from the measurement stencil repository, the associated normal 
values table for the measurement scheme is retrieved from the normal values repository. 

When a measurement entity node of the measurement scheme is visited in the measurement dependency graph, the 
medical nomenclature of the measurement entity and patient-specific data (such as gender, age, length...) are used 
25 as a selector in the normative values table of the measurement scheme. 

The normative value, and the associated comparison function are retrieved from the normative values table, after which 
measurement value and normative value are compared. 

An abnormality signalling function alerts the physician should the measurement value lie outside the normal range. 
This functionality is instantaneous, that is, normality or abnormality of a measurand is signalled immediately when the 
30 result of the measurement value computation is known. This ability is impossible in the prior art, wherethe measurement 
value needs be looked up afterwards in the proper atlas. 

[0121] Normal values and other numeric information useful for measurements in radiology are calculated and pre- 
sented in many different ways, for example as 

35 - a fixed cut-off value. 
Examples: 

any value of the angle of the epiphyseal axis with the cylindrical bone axis different from 0° may be indicative 
of a metaphyseal fracture 

40 - a metacarpal II index (which is 1 00 times the sum of cortical thickness divided by width) smaller than 44 may 

be indicative of osteoporosis 

a demographic and patient data-specific cut-off value. This case differs from the previous one in that the cut-off 
or threshold value is made dependent on e.g. the age and gender of the patient, ethic race, body weight, height, 
45 body surface etc. Hence, the cut-off value is a function of one or more variables, which may be stored in discrete 

form by sampling the function at suitable intervals. The electronic calculation re-samples the interpolated function 
to retrieve the final threshold. 

a normative value presented with statistical upper and lower limits, these limits being defined as the mean value 
plus or minus a number of standard deviations (SD). This latter tolerance range is normally equal to -2SD to +2SD, 
50 and means that about 2% of a normal population will be assessed as abnormally large and around 2% as abnor- 

mally small with respect to the parameter assessed. As with the foregoing case, the tolerance range may be 
function of a number of variables. 

a threshold based on a multiple of the standard deviation, the SD being calculated on the basis of the deviation 
with respect to an ideal fitted geometric object (fit line, fit parabola, fit circle, fitted ellipse etc.) Example: vertebral 
55 displacements due to dislocations and diagnosed by means of the perpendicular distance of anatomical landmarks 

with respect to an analytic curve fitted through corresponding anatomical landmarks of a sequence of vertebrae, 
a nomogram (or nomograph), which is a graph containing several (usually three) parallel scales graduated for 
different variables so that when a straight line connects values of any two, the related value may be read directly 
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from the third at a point intersected by the line. It assists in estimating data that normally would require intricate 
calculations. For example, carpal length relationships are usually determined by a nomogram, where the grade of 
deviance from the mean for a specific child is established by placing a ruler between the two points on the scales 
that correspond to specific measures in the hand radiograph of the children. The electronic implementation stores 
5 the axes in discrete form. To retrieve the grade of deviance, the position along the axis is interpolated from the 

value of the known input variables, followed by an emulation of the graphical construction to retrieve the requested 
deviance given the input variables. 

[0122] The measurement template provides a coupling between an individual entity and its normative value through 
10 a link to a record in a normative reference database. 

The normative reference database is organised around tables, grouping mean value and standard deviations for each 
measurement scheme in one table. 

Tables may further be organised hierarchically according to a whole-part relationship (e.g. a normative table for spinal 
measurements may be composed of tables forthe individual vertebrae). The link may be through the generally accepted 
15 medical name for the anatomical quantity or it may be based on a unique identifier when the quantity is referred to by 
a plurality of names according to different translations or user preferences. 

[0123] Just as measurement values and their uncertainty bounds are displayed graphically, the normal values may 
be depicted by suitable graphical mark-up as well. For example, along with the actual measurement value, the mean 
value and thetwo-sigma range of an angle forthe normal population may be depicted in the image with three additional 

20 lines. Referencing may be either centrally, or with respect to one of the constituent measurement objects (that is with 
respect to one of the points in a point pair for distance measurements, or with respect to one of the lines in a line pair 
for angle measurements). This representation enables the clinician to graphically assess the actual measurement 
value in relationship to the average population. To avoid confusing superposition of too many lines in the radiographic 
image, all graphical mark-up pertaining to a particular measurand may be grouped in a separate layer, the display of 

25 which may be switched on and off on user's request. 

• Reporting and saving the results of a measurement session 

[0124] Analogous to graphical and numerical input to a measurement session, both numerical and graphical results 
30 may be reported and saved. Measurement results and their applicable normal values are stored in the patient dossier 
in a suitable data format (such as XML). Furthermore, the graphic representation of a measurement session is saved 
as well in a suitable graphic format (such as SVG), and it is linked with the image, so that it may be redrawn onto the 
image at future referral. 

Alternatively, the actualised graphics may be stored as a template, to be used in new measurement sessions during 
35 follow-up of a patient for example. 

General system overview 

[0125] A general overview of the measurement system is shown in fig. 1 . From a software functionality viewpoint, 
40 the system comprises an engine and a user interface. 

[01 26] The engine (E) guides the measurements that are performed on the retrieved (3) and displayed (4) radiological 
image by performing a generic execution of a measurement template. 

[0127] It loads and activates a selected measurement template from a stored database (1) by (a) loading the meas- 
urement dependency graph into memory, (b) displaying (18) the graphical part of the measurement template, (c) reg- 
45 istering all available methods specified by each measurement entity or object (both 'external' and 'internal' methods 
associated with the graphical part and the graph node part respectively). 

It starts execution of the measurements at the topmost measurement entity as specified by the measurement template 
or as selected by the user, and traverses the measurement dependency graph while chaining the nodes along its path. 
When a leave node associated with a user-defined measurement point fires, the engine controls the graphical mapping 

50 (5) of the point in the image. To this purpose, the engine (a) passes control to the user interface when the point mapping 
is performed by the userwho drags (6) the measurement objects onto an image position in accordance with the template 
after which the point's position is passed (7) to the measurement calculation module, or (b) initiates appropriate region 
of interest processing (e.g. contrast enhancement, geometric manipulation such as zooming, or feature-specific filtering 
to enhance the desired anatomical landmarks), or (c) performs the deformable contour-based segmentation for active 

55 measurement templates, in which case the position of the measurement points is established in spatial relationship to 
said contours and which positions are passed (7) to the measurement calculation module. The initial position of the 
deformable contours may be determined using a small number of mapped anchor points (6). 

When an internal node of the graph fires (which is either a measurement object node or a measurement operator 
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node), the measurement computation module (A) computes the values of parameters of the node based on the values 
of the depending nodes. For example, the computation of the intersection point of two lines falls under this category. 
When the node is a measurement operator, the value of the measurement is computed and the measurement result 
is depicted graphically onto the radiological image (8). 

5 In a specific embodimentthe engine furthercontrols selection (9) and addressing (1 0) of normative values in a normative 
values table by a selection module (B), which normative values table is retrieved from a normal values repository (2). 
Both normative value (11) and actual measurement (12) are supplied to an abnormality judgement device (C), which 
calculates the presence and degree of abnormality of the measurement value. The deviation from normality may be 
depicted graphically in the radiological image (1 3). The measurement results (14) and their degree of abnormality (1 5) 

10 is updated in a spreadsheet and clinical database. All graphical results of the measurement session are saved along 
with the image (1 6). 

[0128] The user interface (D) basically consists of a database, a controller and a graphics part. 
All graphical objects to be drawn in the image such as measurement objects (e.g. points, lines, circles...) and graphical 
measurement mark-up (e.g. distance and angle double-side arrow line segments) are generated and stored in a da- 
15 tabase created and maintained at run-time. 

The controller reacts to events such as the user pressing a mouse button or running a dialog box, starting a command, 
addition of an object to the database, notification and modification of objects that other objects onto which they are 
based have changed etc. 

The user interface's responsibility is to render all measurement entities and measurement results. 
20 in particular it renders the measurement template in the template window (1 8), and changes appearance of entities in 
it in the course of the measurement procedure e.g. to hint the user to the next point to map. 

It generates or updates the graphical representation of all objects currently in the database, and superimposes it onto 
the display of the image in the image window (4). 

[0129] It further renders and updates the measurement values in the measurement values window (1 7). 
25 In a specific embodiment, normative values are displayed (20) in the measurement values window, along with the result 
of comparison of measurement values with their respective normative values (19). 
[0130] From the software architecture viewpoint, the system is organised into layers. 

The system software layer, the bottom layer, contains components such as operating systems, databases, interfaces 
to specific hardware and so on. 
30 The middle-ware layer contains components such as GU I builders, interfaces to database management systems, plat- 
form-independent operating system services, and ActiveX-components such as spreadsheets and diagram editors. 
The business-specific layer, contains business specific components used in several applications. For example, a library 
of calculations on geometric objects falls into this layer. 
The application layer, the top layer, contains the application specific services. 

35 



Claims 
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55 



1. A method of performing geometric measurements on a radiological image comprising the steps of 



acquiring a digital image representation of said radiological image, 

applying said digital image representation to a display device connected to a computer and displaying said 
image, 

activating a measurement scheme that has been stored in said computer, said measurement scheme com- 
^5 prising a graphical part representing a relation between measurement entities and anatomy present in said 

radiological image and an internal part representing functional dependencies between said measurement en- 
tities; said graphical part and said internal part being bi-directionally linked, 

performing measurements on said displayed image, said measurements being guided by the activated meas- 
urement scheme. 



2. A method according to claim 1 wherein said measurements are performed by displaying said graphical part of said 
measurement scheme and by mapping measurement objects of the displayed graphical part onto a corresponding 
location in said displayed radiological image and by entering the corresponding location into the activated meas- 
urement scheme. 

3. A method according to claim 1 wherein said measurement scheme is selected from a measurement scheme re- 
pository comprising a number of measurement schemes adapted to different examination types and/or different 
radiological exposure conditions. 



19 



EP 1 349 098 A1 



4. A method according to claim 1 wherein said measurement scheme is a passive measurement scheme. 

5. A method according to claim 2 wherein constituent points of measurement objects are placed manually in said 
image. 

6. A method according to claim 2 wherein constituent points of measurement objects are placed by the steps of 
magnifying a region of interest surrounding the location of said constituent point in said image and/or in said meas- 
urement scheme and by manually placing said points in said image. 

7. A method according to claim 2 wherein values of measurands are computed by applying measurement operators 
onto geometric locations of measurement objects. 

8. A method according to claim 1 wherein said measurement scheme is an active measurement scheme. 

9. A method according to claim 1 wherein said graphical part is displayed as an overlay on top of the body part to be 
examined on said displayed image. 

10. A method according to claim 1 wherein said measurement scheme comprises normative values for measured 
entities and wherein upon activation of said measurement scheme said normative values are retrieved and com- 
pared with corresponding measured entities so as to assess a degree of abnormality. 

1 1 . A method according to claim 1 wherein calibration factors are calculated for measurements based upon the image 
of a calibration device which is exposed simultaneously and under identical exposure conditions as the object to 
which said radiological image pertains, and wherein the measurements performed on said displayed image are 
corrected by means of said calibration factors. 

12. A method according to claim 1 wherein uncertainty values are calculated by error propagation of measurements 
and calculations guided by said measurement scheme. 

13. A method according to any of the claims 10, 11 or 12 wherein at least one of said calibrated values, uncertainty 
values, normative values and degrees of abnormality are visualised. 

14. A computer program product adapted to carry out the steps of any of claims 1 to 13 when run on a computer. 

15. A computer readable carrier medium comprising computer executable program code adapted to carry out the steps 
of any of claims 1 to 13. 
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